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INTERNATrONAL SEARCH REPORT 

(PCT Article 18 and Rules 43 and 44) 



Applicant's or agent's file reference 
9805 PCT 


FOR FURTHER ®®® Notification of Transmittal of International Search Report 

(Form PCT/lSA/220) as well as. where applicable, item 5 below. 

ACTION 


International application No. 

PCT/EP 99/06555 


International filing date (day/month/year) 

10/09/1999 


(Earliest) Priority Date (day/month/year) 

15/09/1998 


Applicant 

BARCO N.V. et a1 . 



This International Search Report has been prepared by this International Searching Authority and is transmitted to the applicant 
according to Article 18. A copy is being transmitted to the International Bureau. 

This International Search Report consists of a total of 3 sheets. 

It is also accompanied by a copy of each prior art document cited in this report. 



1 . Basis of the report 

a 



With regard to the language, the international search was carried out on the basis of the international application in the 
language in which it was filed, unless otherwise indicated under this item. 



□ 



the international search was carried out on the basis of a translation of the international application furnished to this 
Authority (Rule 23.1(b)). 



With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international search 
was carried out on the basis of the sequence listing : 

I I contained in the international application in written form. 

filed together with the international application in computer readable form, 
furnished subsequently to this Authority in written form, 
furnished subsequently to this Authority in computer readble form. 



□ 
□ 
□ 
□ 

□ 

□ 
□ 



the statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

the statement that the information recorded in computer readable form is identical to the written sequence listing has been 
furnished 

Certain claims were found unsearchable (See Box I). 
Unity of invention is lacking (see Box II). 



4. With regard to the title, 

I I the text is approved as submitted by the applicant. 

pC] the text has been established by this Authority to read as follows: 

METHOD AND APPARATUS FOR VIDEO SIGNAL PROCESSING 



With regard to the abstract, 

prj the text is approved as submitted by the applicant. 

I I the text has been established, according to Rule 38.2(b). by this Authority as it appears in Box III. The applicant may. 
' — ' within one month from the date of mailing of this international search report, submit comments to this Authority. 

The figure of the drawings to be published with the abstract is Figure No. 2 



[X] as suggested by the applicant. |^ None of the figures. 

I I because the applicant failed to suggest a figure. 

I I because this figure better characterizes the invention. 
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A. CLASSIFICATION OF SUBJECT . 
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According to International Patent Classification (IPC) or to both national classification and IPC 




B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 H04N 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category " Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 
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abstract 

column 7, line 32 - line 42; claims 

EP 0 708 564 A (AT & T CORP) 

24 April 1996 (1996-04-24) 

page 4, line 9 -page 5, line 20 

page 8, line 41 -page 9, line 51; claims; 

figures 

-/— 



1-21 



1-21 



1-21 



(H 



Further documents are listed in the continuation of box C. 



0 



Patent family members are listed in annex. 



Special categories of cited documents ; 

"A" document defining the general state of the art which is not 
considered to be of particular relevance 

"E" earlier document but published on or after the international 
filing date 

"L" document which may throw doubts on priority clalm(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

"P" document published prior to the international filing date but 
later than the priority date claimed 



later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken atone 

document of particular relevance; the claimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of the actual completion of the international search 

28 December 1999 


Date of mailing of the international search report 

12/01/2000 


Name and mailing address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL - 2280 HV Rijswijk 

TeL (-*-31-70) 340-2040, Tx. 31 651 epo nl. 
Fax: (+31-70) 340-3016 
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Foglia, P 
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Category ° Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



us 5 606 373 A (DOPP ET AL.) 

25 February 1997 (1997-02-25) 

coluftin 1, line 21 - line 54 

column 2, line 30 -column 3, line 13; 

figures 3-5 

EP 0 720 366 A (THOMSON CONSUMER 
ELECTRONICS) 3 July 1996 (1996-07-03) 
page 5, 1 ine 17 - 1 ine 26 
page 8, line 6 - line 18; figures 1,16,17 

WO 97 39586 A (FAROUDJA Y C) 

23 October 1997 (1997-10-23) 

page 17, line 14 -page 19, line 30; figure 

15 

EP 0 851 677 A (SONY CORP) 
1 July 1998 (1998-07-01) 
the whole document 

US 5 742 351 A (GUEDE FREDERIQUE) 
21 April 1998 (1998-04-21) 
the whole document 

EP 0 629 083 A (SAMSUNG ELECTRONICS CO 
LTD) 14 December 1994 (1994-12-14) 
abstract 

page 6, line 14 - line 36; figure 3 
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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 

(PCT Article 36 and Rule 70) 




Applicants or agent's file reference 
29129-WO-U 



See Notification of Transmittal of International 
FOR FURTHER ACTION Preliminary Examination Report (Form PCT/IPEA/416) 



International application No. 
PCT/EP99/06555 



International filing date (day/month/year) 
10/09/1999 



Priority date (day/month/year) 
1 5/09/1 998 



International Patent Classification (IPC) or national classification and IPC 
H04N7/26 



Applicant 

BARCO N.V. et al. 



2. 



This international preliminary examination report has been prepared by this Intemational Preliminary Examining Authority 
and is transmitted to the applicant according to Article 36. 

This REPORT consists of a total of 7 sheets, including this cover sheet. 

n Thic r^r^nrt is also accomoanied by ANNEXES, i.e. sheets of the description, claims and/or drawings which have 
ITen T^^^^^^ this report and/or sheets containing rectifications made before th.s Author.y 

{see Rule 70.16 and Section 607 of the Administrative Instructions under the PCT). 

These annexes consist of a total of sheets. 



3. This report contains indications relating to the following items: 



Lack of unity of invention 

Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial appl.cab.lrty; 

citations and explanations suporting such statement 

Certain documents cited 

Certain defects in the international application 

Certain observations on the international application 



I 




II 


□ 


III 


□ 


IV 




V 




VI 


□ 


VII 


IS 


VIII 





Date of submission of the demand 
13/04/2000 



Date of completion of this report 
13.10.2000 



Name and mailing address of the international 
preliminary examining authority: 
European Patent Office 

D-80298 Munich 
Tel. +49 89 2399 - 0 Tx: 523656 epmu d 

Fax: +49 89 2399 - 4465 



Authorized officer 
de Dieuleveult, A 

Telephone No. +49 89 2399 8946 



Form PCT/I PEA/409 (cover sheet) (January 1994) 



INTERNATIONAL PRELIMINARY 
EXAMINATION REPORT 



International application No. PCT/EP99/06555 



I. Basis of the report 

1 This report has been drawn on the basis of (substitute sheets which have been furnished to the receiving Office in 
■ resp!>n °e toan invitation under Article 14 are referred to in this report as -originally filed" and are not annexed to 

the report since they do not contain amendments.): 

Description, pages: 

1.-19 as originally filed 



Claims, No.: 

1-21 

Drawings, sheets: 

1/3-3/3 



as originally filed 



as originally filed 



2. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 

□ the drawings, sheets: 

3 □ This report has been established as if (some of) the amendments had not been made, since they have been 
considered to go beyond the disclosure as filed (Rule 70.2(c)): 



4. Additional observations, if necessary: 



IV. Lack of unity of invention 

1 . In response to the invitation to restrict or pay additional fees the applicant 

□ restricted the claims. 

□ paid additional fees. 

□ paid additional fees under protest. 

□ neither restricted nor paid additional fees. 



Form PCT/IPEA/409 (Boxes I- VIM. Sheet 1) (January 1994) 



INTERNATIONAL PRELIMINARY DnT/PPQQ/nR^«S«5 
EXAMINATION REPORT International application No. PCT/EP99/Uba55 

2 B This Authority found that the requirement of unity of invention is not complied and chose, according to Rule 
68.1 . not to invite the applicant to restrict or pay additional fees. 

3. This Authority considers that the requirement of unity of invention in accordance with Rules 13.1. 13.2 and 13.3 is 

□ complied with. 

H not complied with for the following reasons: 
see separate sheet 

4. Consequently, the following parts of the international application were the subject of international preliminary 
examination in establishing this report: 

la all parts. 

□ the parts relating to claims Nos. . 



V Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial 
applicability; citations and explanations supporting such statement 

1. Statement 
Novelty (N) 

Inventive step (IS) 



Yes: 


Claims 


1-18,20,21 


No: 


Claims 


19 


Yes: 


Claims 




No: 


Claims 


1-21 


Yes: 


Claims 


1-21 


No: 


Claims 





2. Citations and explanations 
see separate sheet 

VII. Certain defects in the international application 

The following defects in the form or contents of the international application have been noted: 
see separate sheet 
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INTERNATIONAL PRELIMINARY prT/EP99/06555 
EXAMINATION REPORT Intemat.onal application No. PCT/EP99/06555 

VIII. Certain observations on the international application 

The following observations on the clarity of the claims, description, and drawings or on the question whether the 
claims are fully supported by the description, are made: 

see separate sheet 
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INTERNATIONAL PRELIMINARY international application No. PCT/EP99/06555 
EXAMINATION REPORT - SEPARATE SHEET 



IV. Lack of unity 

The separate groups of invention are: 

- Claims 1-18 and 20-21 deal with a method or apparatus for discriminating 
between a video mode and a film mode so that a median filtering or a merging 
operation is carried out correspondingly; 

- Claim 19 deals with an apparatus for doubling and/or quadrupling and applying a 
field rate conversion. 

They are not so linked as to form a single general inventive concept (Rule 13.1 
PCT). 



V. Reasoned statement 

1 Reference is made to the following documents: 

D1 : EP-A-0 720 366 (THOMSON CONSUMER ELECTRONICS) 3 July 1 996 

D2: EP-A-0 708 564 (AT & T CORP) 24 April 1 996 

D3: US-A-5 606 373 (DOPP ET AL.) 25 February 1997 

D4: US-A-5 742 351 (GUEDE FREDERIQUE) 21 April 1998 

D5: EP-A-0 851 677 (SONY CORP) 1 July 1998 

D6: EP-A-0 536 721 (SALORA OY) 14 April 1993 

D7: EP-A-0 584 662 (NOKIA TECHNOLOGY GMBH) 2 March 1 994 



Claim 1: 

Document D1 discloses (see page 2, lines 19-41) a method for video processing, 
wherein possible movement between successive fields of the image split into even 
and odd is detected and the mode, i.e. video mode or film mode is determined, 
the sequence of movement or standstill between successive fields is detected and 
this sequence over a number of fields is stored in a memory, followed by said 
sequence being compared with patterns inherent to the mode. 
Similar prior art is also disclosed in D2 (see p. 4. I. 9 - p. 6. I. 3). in D3 (see col. 1. 
I. 6 - col. 4, I. 56) and D4 (see col. 1, I. 10 - col. 3, I. 2). 

The method of document D1 further comprises the step wherein, if film mode is 
detected, then in synchronisation with the film phase, the even and odd fields 
which match and are derived from one and the same film image are merged again 
until the original film image is obtained and said image is repeated until again a 
following original film image can be constructed by means of the abovementioned 
merging (see p. 2, I. 5-11). 
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INTERNATIONAL PRELIMINARY International application No. PCT/EP99/06555 
EXAMINATION REPORT - SEPARATE SHEET ^ 

Besides, document D1 also states that "film mode video field identification" may 
be used in "progressive scan conversion of interlaced video signals" (see p. 3, 
1.19-24). 

Such a "scanning line number converting process" is disclosed in D5 wherein, if 
ordinary video mode is detected, median filtering is carried out whereas, if film 
mode is detected, the median filtering is switched off (see p. 3, I. 22-43). 
Consequently, the claimed subject-matter lacks an inventive step with respect to 
the combined disclosure of D1 and D5. 



3. Claim 14: 

A similar objection as to lack of inventive step likewise applies to this 
corresponding apparatus claim. 



4. Claim 19: 

Documents D5 or D6 discloses an apparatus for video processing including 
means for employing doubling and a field rate converter from 50 Hz to 100 Hz. 
Therefore, the subject-matter of this claim lacks novelty with respect to the 
disclosure of either D5 or D6. 

Besides, "quadrupling" is also widely known in the art (see D7, col. 1, 1. 8-36). 

5. Claims 2-13. 15-18, 20 and 21: 

These dependent claims do not appear to comprise any additional features that 
would render their subject-matter inventive over the available prior art. 
Therefore, these claims fail together with independent claims 1 and 14 for lack of 
inventive step. 



VII. Certain defects 

1 . The features of the claims are not provided with reference signs placed In 
parentheses (Rule 6.2(b) PCT). 

2. Contrary to the requirements of Rule 5.1(a)(ii) PCT, the relevant background 
disclosed in the documents D1-D7 is not mentioned in the description, nor ar 
these documents identified therein. 
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EXAMINATION REPORT - SEPARATE SHEET 



PCT/EP99/06555 



The vague and imprecise statement in the description on page 19, lines 23-27 
implies that the subject-matter for which protection is sought may be different to 
that defined by the claims and should therefore be removed (see the PCT 
Guidelines PCT/GL/3 III, 4.3a). 

There seems to be a discrepancy in the text as to which field is present on line 1 A 
and 12 of Fig.1 (see p. 4. I. 30 and p. 10, I. 25). 



VIII. Certain observations 

1 . It is not clear: 

- in claim 1: what "video processing" is supposed to take place; nor which signals 
are subjected to the "median filtering"; 

- in claim 14: similarly, which "processing" is to be synchronized with the film 
phase; nor what "a film processor proper" designates; 

- in claim 19: what "doubling" and "quadrupling" mean. 
Therefore, the requirements of Article 6 PCT are not satisfied. 



Besides: 

- in claim 1: only reference signs which shall not be construed as limiting the claim 
can be placed between parentheses. The indication "2:2 pull-down or 3:2 pull- 
down" should thus be deleted; 

- in claim 14: "for employing" should read "comprising means for carrying out all 
the steps of"; 

- in claim 19: "for example" should be deleted; and "50 or 60 Hz to 100 or 120 Hz" 
should read "50 to 100 Hz or 60 to 120 Hz". 
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(57) Abstract 

Method and apparatus for video processing, wherein possible movement between successive fields of the images split into even and 
odd is detected and the mode, i.e. video mode or film mode is determined, characterized in that the sequence of movement or standstill 
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METHOD AND APPARATUS FOR VIDEO SIGNAL PROCESSING 

The present invention relates to a method for video 
processing, wherein possible movement between 
5 successive fields of the images split into even and odd 
is detected and the mode, i.e. video mode or film mode 
is determined. 

More in particular, the invention relates to the 
10 processing of video signals from a video tape, a DVD, a 
laser disc, a tuner, etc. and therefore of standard 
PAL, SECAM and NTSC video signals. 

Given that, in particular in the case of film mode, be 
15 it so-called "2:2 pull-down" or so-called "3:2 pull- 
down", which involve the film images being split into 
even and odd fields, the quality of the image on the 
monitor can exhibit annoying effects if these signals 
are processed in the classical manner, it is known to 

2 0 determine, via movement detection, between successive 

fields, according to what mode the current video signal 
was converted in order then to carry out specific 
further processing of the film mode signals. 

25 With known methods, the movement detection is carried 
out by detecting possible movement of the edges of the 
fields, the result being that rapid intervention will 
take place in the event of many details in a field. 
This requires a large number of auxiliary devices such 

3 0 as a battery of correlators. 

Employing these known methods therefore requires a 
relatively expensive and bulky apparatus. 

3 5 It is an object of the invention to provide a method 
for video processing which avoids these and other 
drawbacks and which, even in the case of film mode, is 
able to display a high-quality image on the monitor. 
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while using a relatively inexpensive apparatus wiiich 
can be of compact design. 

This object is achieved according to the invention by 
5 the sequence of movement or standstill between 
successive fields being detected and this sequence over 
a number of fields being stored in a memory, followed 
by said sequence being compared with patterns inherent 
to the mode and, if ordinary video mode is detected, 

10 median filtering is carried out whereas, if film mode 
(2:2 pull-down or 3:2 pull-down) is detected, the 
median filtering is switched off and, in 
synchronization with the film phase, the even and odd 
fields which match and are derived from one and the 

15 same film image are merged again until the original 
film image is obtained and said image is repeated until 
again a following original film image can be 
constructed by means of the abovementioned merging. 

20 The movement detection, i.e. the detection of the 
abovementioned sequence of movement and standstill, can 
be performed by a three-point median filtering 
operation, after which the result of said median 
filtering operation and the incoming information of a 

25 following field is filtered by two low-pass filters, 
the absolute difference of the result of these two low- 
pass filters is calculated and the differences are 
summed, the sum, possibly divided by a nximber, being 
compared with a threshold value, the result of said 

30 comparison forming the abovementioned sequence, stored 
in a memory, of the movement and standstill between 
successive fields . 

The video signals to be processed are preferably 
3 5 subjected to doubling, and preferably also quadrupling 
and preferably also field rate doubling. 
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The invention also relates to an apparatus which is 
particularly suitable for employing the method 
according to any one of the above embodiments . 

5 The invention therefore relates to an apparatus which 
includes a movement detector, a film mode /video mode 
detector connected thereto, synchronization means to 
synchronize processing with the film phase, and a film 
processor proper. 

10 

Preferably, the movement detector is connected to a 
median filter having as inputs the current field and 
the next field of the video images, and includes two 
low-pass filters, one of which connects to the output 

15 of the median filter and the other has as an input the 
information of the next incoming field, a 
differentiator which connects to the two low-pass 
filters to calculate the difference between the outputs 
of these, a summator connected to said differentiator, 

20 a counter connected to said summator and a comparator 
connected thereto for comparing the output of the 
counter with a threshold value. 

Preferably, the film mode/ video mode detector includes 
25 a shift register in which the result of the comparator 
over a number of fields is stored, so that a comparison 
is possible with a pattern inherent to a specific mode. 

The apparatus may include means for employing doubling 
3 0 and/or means for performing quadrupling, and a field 
rate converter from 50 or 60 Hz to 100 or 120 Hz. 

With a view to providing a better demonstration of the 
characteristics of the invention, preferred embodiments 
35 of a method and apparatus for video processing 
according to the invention are described hereinafter, 
as an entirely non- limiting example, with reference to 
the accompanying figures in which: 
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Figure 1 represents a block diagram of an 
apparatus used for implementing the method 
according to the inventions- 
Figure 2 schematically represents the 2:2 pull- 
5 down conversion and processings- 

Figure 3 schematically represents the movement 
sequence between the fields in the case of film 
processed by 2:2 pull-down; 

Figure 4 schematically represents the 3:2 pull- 
10 down conversion and processings- 

Figure 5 schematically represents the movement 
sequence between the fields in the case of film 
processed of 3:2 pull-down. 



15 Starting with interlaced video having 525 lines at 
60 Hz or 625 lines at 50 Hz, the interlacing is firstly 
moved and the video is therefore first converted to 
non-interlaced video. 



2 0 For this purpose use is made of a known or progressive 
scanning technique, in which a three-point median, 
obtained with the aid of median filter 1, carries out 
the compensation for movement. 



25 In the case of interlaced video, each frame consists of 
two fields, successive even and odd fields being 
shifted by half a line with respect to one another. The 
three-point median has as its input the pixels lying 
vertically above one another of two successive lines 

3 0 from the current field coming in via lA and the pixel 
vertically below of the intermediate line of the 
following field coming in via IB. 



The result of the median processing, combined with the 
35 original lines of the current image, provides a 
movement-compensated image of 625 or 525 lines, non- 
interlaced, and 50/60 Hz. 
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The result of the median filter 1 is stored in a memory 
bank (display bank) 2 which consists of two image FIFOs 
3 and 4 which are written in interlaced form. The even 
pixels go to FIFO 3, the odd pixels to FIFO 4. 

5 

"Doubling" is the constant read-out of the display bank 
2 at the normal rate. 

After interlacing has been removed, a stable image 
10 without line flicker is obtained. To obtain optimal 
screen coverage on CRT-based monitor systems, a 
quadrupling technique is used additionally. 

Simultaneously with the calculation of the median in 
15 the median filter 1, vertically intermediate pixels are 
calculated via vertical linear interpolation in the 
interpolator 5, which connects, via 5A to the output of 
the median filter 1. Again, 625/525 lines of non- 
interlaced 50/60 Hz are obtained. 

20 

The result of this interpolation is stored in a memory 
bank (display bank) 6 which, like the abovementioned, 
consists of two image FIFOs 7 and 8 which are written 
in interleaved form. The even pixels go to FIFO 7, the 
25 odd pixels to FIFO 8. 

To obtain a quadrupled image, a line of the display 
bank 2 and a line of the display bank 6 is read 
alternately by a memory controller 9, the result being 
30 relayed to a digital-to-analogue converter 10. 

Each line consists of 1024 pixels, 512 even pixels from 
FIFO 3 or 7, and 512 odd pixels from FIFO 4 or 8, which 
are read out in interleaved form and in the correct 
35 pixel phase. Ultimately, a total image of 1250 or 1050 
lines, non-interlaced, is obtained a line frequency of 
64 kHz and a frame rate of 5 0 or 60 Hz, respectively. 
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To render the plane flicker inherent to low frame rates 
of 50 or 60 Hz invisible, recourse is moreover had to 
field rate upconversion, which involves increasing the 
frequency to 100 to 120 Hz. 

5 

In a first embodiment, the lines of the abovementioned 
display bank 2 are read out by the memory controller 9 
twice in succession and at twice the normal rate and 
therefore at a frequency of 100 or 120 Hz instead of 50 
10 or 60 Hz, an image being foirmed which has 625 or 525 
lines, respectively, non-interlaced, displayed at 
double the frame rate. The line frequency is then 
64 kHz. 

15 To retain the advantage of better screen filling, it 
would be necessary to change to a line frequency of 
128 kHz, which cannot be achieved by most display 
equipment. To solve this problem, the memory controller 
9, in a second embodiment, first reads out the entire 

20 contents of the display bank 2 at twice the normal rate 
and then, at twice the noarmal rate, reads out the 
entire contents of the display bank 6 . Since both 
display banks 2 and 6 are alternately read out at twice 
the rate, a resulting field rate of 100 or 120 Hz will 

25 again be obtained. 

Since the contents of the display bank 2 differ 
spatially from the content of the display bank 6, it is 
necessary to ensure that the data of both display banks 
30 2 and 6, which do agree temporally, are not written to 
the same position on the monitor. To achieve correct 
interlacing at 100 or 120 Hz, the outgoing vertical 
frame pulse (100/120 Hz) is then, every other frame, 
shifted upwards by half a 64 kHz line. 

35 

As a result of the interlacing, the information from 
the one display bank ends up in between the infoarmation 
of the other display bank 6, which produces optimal 
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screen coverage within the same time as with normal 
quadrupling (20 ms or 16.6 ms) . 

This type of image, because of the interlacing using 

5 non-equidistant frame pulses instead of equidistant 

frame pulses, can be used only on equipment which 

supports this type of interlacing, such as HDTV- 
compatible equipment . 

10 The frame pulse for the second 100 or 12 0 Hz field must 
be calculated. The length of the frame is measured on 
the basis of the number of 64 kHz lines in an original 
field. The second frame pulse is positioned in the 
middle between two original frame pulses . Without 

15 interlacing, equidistant 100 or 120 Hz frame pulses 
will be obtained. 

The field rate upconversion can therefore be applied 
both to the doubling technique and to the quadrupling 

2 0 technique, with the option of doubling and quadrupling 

being employed separately, in conjunction with field 
rate upconversion or without it. In the case of 
doubling, the display bank 2 is constantly read out at 
normal rate, in the case of quadrupling every other 
25 line of the display banks 2 and 6 are read out at 
normal rate, in the case of doubling and field rate 
doubling the display bank 2 is read out constantly at 
double the rate, whereas in the case of quadrupling and 
field rate doubling, complete fields are read out 

3 0 alternately from the display banks 2 and 6 at double 

the rate, followed by interlacing with respect to the 
frame pulse . 

Apart from video mode, i.e. normal video recordings in 
3 5 which movement can take place between each field (2 0 or 
16,6 ms interval), the apparatus is able to process 
transmissions in other modes, including film mode or 
derivatives thereof such as video editing mode 
transmissions, in which mixing takes place of normal 
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video images with film mode images, and film editing 
mode, in which the input consists entirely of film mode 
images, but the correct sequence is missing, 

5 Film mode can take the form of so-called "2:2 pull- 
down", in which 24 film images per second are converted 
into PAL 5 0 Hz with 5 0 images per second or 3 0 film 
images per second are converted into NTSC 6 0 Hz with 60 
images per second, or of so-called "3:2" pull-down" , 
10 where 24 film images per second are converted into NTSC 
6 0 Hz and therefore 6 0 images per second. 

In the case of "2:2 pull-down" , the film, in order to 
be transmitted in the PAL transmission standard, is 

15 slightly accelerated to 25 images per second, and each 
film image or frame is then split into an even and an 
odd image or field, so that two fields A and B or C and 
D or E and F etc . are obtained which match one another 
and occupy the same temporal position but are spatially 

20 situated on a different location, i.e. are separated, 
as seen vertically, by half a scan line, as represented 
in the top section of Figure 2 . 

Each field A, B, C etc. consists of lines, 312.5 lines 
2 5 in the case of PAL, which in Figure 2 exist as Aq / Ai , 
A2, etc. for field A, Bq , Bi, etc. for field B, etc. 
The original film image can be restored by the even and 
odd field successively being shown and interlaced on 
the monitor. 

30 

Likewise, to be able to transmit a film having 3 0 
images per second in NTSC standard, each image or frame 
is analogously split into an even and an odd field. 

35 In the case of "3:2 pull-down" , as represented in the 
top section of Figure 4, frames consisting of an even 
and an odd field, for example field A and field B, are 
composed from, on the one hand, even and odd fields 
from the same instant and, on the other hand, an even 
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field of one instant and an odd field of the other 
instant, for example from odd field A, even field A', 
odd field A, even field B, odd field B', etc, so that 
ultimately 60 images per second are again achieved. 

5 

Starting from six original image frames, 15 interlaced 
fields are produced. Successively, three images or 
frames are split into an even and odd field obtained, 
followed by two split frames comprising an even field 
10 of one image and an odd field from another image, the 
upshot being that for each five successive fields, one 
field is repeated. 

Film transmissions and therefore 2:2 and 3:2 pull-down 
15 images will, given correct detection and processing, 
give qualitatively much better results that normal 
video images . 

In the above-described de- interlacing, use is made of a 

2 0 median filter 1 to obtain correct movement 

compensation. A median filter has the drawback, 
however, that it cannot readily cope with lines moving 
diagonally with the result that small steps or 
serrations, so-called "jaggies", are produced on the 
25 diagonals. 

This is a highly annoying effect, which is even more 
noticeable in film transmissions in 2:2 or 3:2 pull- 
down form. 

30 

To ensure that this effect is markedly reduced with 
film transmissions, the de-interlacing must be effected 
without a median filter. 

3 5 In the first instance, therefore, a movement detector 

11 is used to detect between which fields there is 
movement and between which fields there is absolutely 
no movement . 
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This is done by observing correlations between these 
fields , 

To this end prefiltering is performed as a first step. 

Successive fields A (comprising lines Aq , Ai , etc) and 
B (comprising lines Bq . Bi, etc), which may match, do 
come from the same instant but, as a result of the 
image having been split vertically when film was 
converted to video transmission, they differ spatially. 

Consequently it would be wrong for the pixel X from 
line AO to be compared with pixel X from line Bq / given 
that these are spatially separated; instead, the result 
of the abovementioned median filter 1, i.e. the median 
of pixel X of AO, Ai and Bo will be compared with the 
pixel X from line Bo, since this median spatially 
coincides with pixel X from line Bq . 

This is enough to obtain a first improvement in being 
able to find possible correlation between a field A and 
a field B. 

The result of the median filter 1, on the one hand, and 
the information, coming in via 12, from the next field, 
on the other hand, are each filtered by means of a low- 
pass filter 13 or 14, for example a relatively 
inexpensive recursive filter, which continuously 
averages a number of successive pixels, for example 32, 
in accordance with the equation: 
(32.xold - l-^old + 1 .xnew) (1/32) . 

The movement correlation is performed on the low 
frequencies and not on sharp transitions or details, in 
order not to be too strongly dependent on the net 
bandwidth of the input signal and on the possible 
errors of the median filter 1. 
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Then, for each pixel, the absolute difference is 

calculated, in the differentiator 15, between the 

result of the low-pass filter 13 for the result of the 

median filter, and the low-pass filter 14 for the 
5 incoming next image . 

The successive absolute differences are summed in the 
summator 16, and each time there is an overflow of, for 
example, 2^ or 512, the counter 17 connected thereto is 
10 incremented. What this amounts to is that the total sum 
of the absolute differences is divided, for example, by 
512 in order to limit the magnitude of the final 
number . 

15 This process is carried out over an entire field, but 
preferably also limited or keyed by so-called 
"windowing" from a specific start line to a specific 
stop line and from a specific start pixel to a specific 
stop pixel . 

20 

At the end of each field, the output of the counter 17 
yields a number which, in principle, indicates that 
degree of movement between two successive video fields. 

25 In a third step a relevant criterion is defined for 
determining whether there is indeed movement or 
standstill . 

In the event of movement of bright images, the result 
30 of the sum of the absolute differences between two 
successive fields will, on average, be higher than in 
the case of dark fields. Consequently, the calculation 
of the threshold value for the movement criterion takes 
account of the luminance value of the current image 
35 being processed. 

At the same time as the sum of the absolute 
differences, therefore, the total sum of the Iximinances 
is also calculated. The threshold value used for 
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movement is an empirically determined fraction of the 
sum of the luminance values, for example l/64th. 
Depending on the current processing operation, this 
threshold value can be doubled or halved. 

5 

If there are small details in the one image or field, 
which shift with respect to the next image, for example 
noise or detailed structures, this can have a 
disruptive effect on the result of the movement 
10 detection. 

If the threshold value comes out too low, the result, 
even with instantaneously standstill between successive 
images or fields, may nevertheless be movement, this 
15 being incorrect. Because of this, that information is 
filtered out by means of the abovementioned low-pass 
filters 13 and 14 in the prefiltering operation. 

In as much as an edge boost, to be described 

2 0 hereinafter, is employed prior to movement detection 

taking place, which may be required for architectural 
reasons in the case of quadrupling, details of fine 
structures may after all play a significant part in 
determining the threshold value so that it is 
25 necessary, in calculating this threshold value, to take 
account of the status of the edge boosting device. The 
more pronounced the edge boost, the higher will the 
ultimate threshold value be. 

3 0 This additional adjustment of the threshold value as a 

compensation for the edge boost is carried out 
simultaneously on the nominal value, for example l/64th 
of the luminance value, double the value and half the 
value . 

35 

The threshold value is then tailored to the processing 
mode . 
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If this processing mode is the detection mode with 
continuous monitoring of the incoming data, the 
movement detection is set to nominal sensitivity, for 
example l/64th of the luminance value. 

5 

Should some film mode or other have been detected and 
the processing have been tailored thereto, the movement 
detection is set to low sensitivity, for example twice 
the nominal threshold value . 

10 

In the case of a third mode, the film resynchronization 
mode (referred to as "film resync mode"), where the 
system is still in film mode but the movement detection 
in a single instance has detected an incorrect film 
15 phase, the processing reverts to standard median 
processing and the movement detection is set to high 
sensitivity, for example half the nominal threshold 
value, to enable rapid detection. 

20 The abovementioned threshold value for movement is 
determined at the end of each field. 

The film mode/video detection proper then takes place 
as follows: 

25 

When the abovementioned result of the counter 17 
exceeds said threshold value, there is movement between 
the successive fields, and comparator 18, connected to 
the counter 17, of the movement detector 11 will 
3 0 generate a logical "1" which is clocked into a shift 
register 19 . 

When, conversely, the abovementioned sum drops below 
the threshold value, there is correlation or no 
3 5 movement and the comparator 18 of movement detector 11 
will detect a logical "0" which is likewise entered 
into said shift register 19, 
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The shift register 19 has a length of a number of bits, 
for example eleven bits, which means that the history 
of the movement detector 11 can be measured over a 
number of fields, for example eleven fields. 

5 

In the case of the film mode/video detection, a 
detector 20 scans the sequence of the shift register 19 
for a specific pattern inherent to the various modes. 

10 The output of the detector 20 is connected, via 20A to 
the comparator 18 for feedback of the threshold value 
which, in fact, is determined in said detector 20. 

In the event of movement in the case of film processed 
15 by 2:2 pull-down, i.e. where a film containing 24 
images per second was converted to 50 images per second 
in PAL and transmission standard 50 Hz or a film with 
3 0 images per second was converted to 60 images per 
second in NTSC 6 0 Hz, the movement sequence will be 
20 0101010101..,, as represented in Figure 3. 

When the detector 20 therefore observes a 01010101.. 
sequence, the decision will be that a "2:2 pull-down 
mode" obtains. 

25 

In the event of movement in the case of film processed 
by 3:2 pull-down, i.e. where a film containing 24 
images per second was converted to 60 images per second 
in NTSC 60 Hz, the movement sequence will be 
30 1010010100101..., as represented in Figure 5, so that, 
when the detector 2 0 therefore observes this sequence, 
the decision will be that a "3:2 pull-down mode" 
obtains . 

3 5 When the detector 20 observes a movement frequency 
1111111, it is assumed that ordinary video obtains, 
which must be processed via standard median filtering. 
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The system, upon detecting a 2:2 or 3:2 "pull-down 
mode" sets the film mode indication high, which means 
that the movement detector 11 must be set to 
insensitive mode and that the processing 
5 synchronization must be started. The detection length 
of the movement detection is also switched over to a 
shorter word length of, for example, six bits instead 
of eleven bits . 

10 The abovementioned processing synchronization is 
necessary to ensure, upon detection of the movement 
sequences associated with 2:2 or 3:2 "pull-down mode", 
that processing of the data will proceed in the correct 
phase . 

15 

For the processing, the median filter 1 is switched off 
and matching fields are merged, and the merged image is 
repeated, as will be explained below in more detail. 

2 0 For the purpose of this synchronization, the apparatus 
includes a synchronizer 21 comprising two oscillating 
shift registers, one of which, hereinafter referred to 
as "3:2 pull-down syncer" 22, produces the sequence 
10100 and repeats it indefinitely, or in other words 

25 continuously produces the 3:2 pull-down processing 
sequence, while the other one, hereinafter referred to 
as "2:2 pull-down syncer" 23 produces the sequence 01 
and repeats it or, in other words, continuously 
produces the 2:2 pull-down processing sequence. 

30 

The output of the synchronizer 21 connects, via 21A, to 
the abovementioned memory controller 9. 

When one of the abovementioned film modes is detected 
35 by the detector 20, the relevant pull-down syncer 22 or 
23 is synchronized by a synchronization pulse coming 
from the film mode/video detection, for example from 
the detector 20. From that instant, the processing 
operation is subjected to the activated syncer 22 or 23 
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which indeed runs entirely synchronously with the 
incoming film phase. 

The activated syncer 22 or 23 also serves as a monitor 
5 reference for the film mode/video detection. When the 
syncer 22 or 23 outputs a zero, and the detector 20 
outputs one, an error has crept into the film phase 
(malfunction in the video source, too many vertical 
on/off structures, situation of video editing, 

10 incorrectly fitted "cue flashes" etc) . In such a 
situation, the apparatus will go into film resync mode, 
the movement detector 11 being set to very high 
sensitivity, and the processing will temporarily be 
switched back to median filtering. For the purpose of 

15 this error detection of the film phase, the output of 
the synchronizer 21 forms part of a feedback loop, via 
21B, to the detector 20. 

These measures ensure that even if the movement is 
2 0 slight and brief, there is still a good chance of 
rapidly retrieving the new film phase. If there is too 
much movement, the movement detector 11 will become 
saturated, and there is a risk that the apparatus can 
no longer distinguish between film mode and video mode. 

25 

The apparatus will then switch over to normal video 
mode, i.e. normal median filtering, and will again 
start to search for film mode using an eleven-bit word 
length for the history of the movement detector 11 and 

30 a nominal sensitivity. From this position, given 
sufficient movement, the correct film phase will be 
found again relatively rapidly. The switch-over in the 
sensitivity of the movement detector 11 can be disabled 
via an interface. There is then a choice of three fixed 

35 settings of the sensitivity. 

The film processing proper takes place as follows: 
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A zero-to-one transition of the movement detector 1 
means that movement has been detected between the 
successive fields. A one-to-one transition means 
continuous movement between the successive fields. A 
5 zero-to-zero transition means standstill between the 
successive fields. A one-to-zero transition means a 
transition from movement to standstill between the 
successive fields . 

10 If the correct film mode has been found and the syncer 
22 or 2 3 is in the correct phase, the requirement, when 
the output of the syncer 22 or 23 is one, is for 
merging to take place of the successive fields, 
whereas, when the output of the syncer 22 or 23 is 

15 zero, repetition of the merged field must take place, 
as schematically indicated in the bottom section of 
Figure 2 for the 2:2 pull-down or, in the bottom 
section of Figure 4, for the 3:2 pull-down. 

20 In the case of 2:2 pull-down, the fields A and B, C and 
D etc. are merged, the line Bq being introduced between 
the lines Aq and Ai, the line Bi between the lines Ai 
and A2/ etc. The merged fields are each time repeated 
once, as represented by arrows at the bottom in 

25 Figure 2. 

In the case of 3:2 pull-down, the fields A and A', B 
and B' etc. are merged, the line A'q being introduced 
between the lines Aq and Ai, the line A'l between the 
30 lines Ai and A2/ etc. The merged fields are each time 
repeated once or twice, as represented by arrows at the 
bottom in Figure 4 . 

Where in normal video mode the result of the median 
3 5 filter 1 is combined with the original lines of the 
current field, the lines of the current field are now, 
via 21A and the memory controller 9, combined with the 
original lines of the next field, so that an image of 
625 or 525 lines is produced which is simply the 
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merging of the even and odd field from one and the same 
image of the film. 

What is introduced between the successive lines is 
5 therefore not the median but the line of a following 
field. In the case of 2:2 pull-down, for example, the 
line Bo is introduced between the lines Aq and Ai, as 
represented in Figure 2, and in the case of 3:2 pull- 
down, as represented in Figure 4, the line A'o is 
10 introduced, for example, between the lines Aq and A'l. 

In the case of film mode, the median filter 1 is 
therefore solely used for measuring but not for 
processing . 

15 

This result of the merger is relayed to display bank 2. 

The abovementioned information is also relayed, via the 
median filter 1, to the interpolator 5, so that the 
20 interpolation is also performed on the merged fields. 
The result of the interpolation is relayed to the 
display bank 6 . 

The display banks 2 and 6 are read out as described 

2 5 above . 

The repetition of the merged fields, which is 
represented at the bottom in Figures 2 and 4 by arrows, 
is effected by preventing writing to the display banks 

3 0 2 and 6, so that, when these display banks 2 and 6 are 

read out, the same so-called "old" information is read 
out . 

The matching even and odd fields coming from one and 
3 5 the same film image are merged once more until the 
original film image is obtained, and this image is 
repeated until it is again possible for a following 
original film image to be constructed by means of the 
abovementioned merger. 
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As already stated previously, the edges and the details 
of the video images can be enhanced selectively by a 
so-called "edge boost" . 

5 

Such an enhancement is performed on the incoming signal 
by means of two phase-linear "finite impulse response" 
or FIR filters having a sum of coefficients of 0, the 
one being a band-pass filter having the coefficients -1 
10 0 2 0-1 and the other a high-pass filter having the 
coefficients -12-1, The sample frequency is 16 MHz. 

The results of the two filters are merged and scaled, 
for example divided or multiplied, and added to the 
15 original video signal. Both filters, for example, have 
eight settings. This allows for various combinations of 
the two filters. 

If excessively pronounced edges are detected, the 
20 filter effect can be attenuated, if required, to 
prevent deadlocks . 

The invention is by no means limited to the embodiments 
described hereinabove and represented in the figures, 
2 5 such a method and apparatus for video processing being 
capable of being implemented in diverse variations 
without falling outside the scope of the invention. 
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Claims 



1. Method for video processing, wherein possible 
movement between successive fields of the images split 

5 into even and odd is detected and the mode, i.e. video 
mode or film mode is determined, characterized in that 
the sequence of movement or standstill between 
successive fields is detected and this sequence over a 
number of fields is stored in a memory, followed by 

10 said sequence being compared with patterns inherent to 
the mode and, if ordinary video mode is detected, 
median filtering is carried out whereas, if film mode 
(2:2 pull-down of 3:2 pull-down) is detected, the 
median filtering is switched off and, in 

15 synchronization with the film phase, the even and odd 
fields which match and are derived from one and the 
same film image are merged again until the original 
film image is obtained and said image is repeated until 
again a following original film image can be 

20 constructed by means of the abovementioned merging. 

2. Method according to Claim 1, characterized in 
that if a film mode is detected, the length of the 
movement sequence which is stored in the memory is 

2 5 shortened. 

3 . Method according to any one of the preceding 

claims, characterized in that the movement detection, 
i.e. the detection of the abovementioned sequence of 
30 movement and standstill, can be performed by a three- 
point median filtering operation, after which the 
result of said median filtering operation and the 
incoming information of a following field is filtered 
by two low-pass filters, the absolute difference of the 

3 5 result of these two low-pass filter is calculated and 

the differences are summed, the sum, possibly divided 
by a number, being compared with a threshold value, the 
result of said comparison forming the abovementioned 
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sequence, stored in a memory, of the movement and 
standstill between successive fields. 

4. Method according to Claim 3, characterized in 
5 that, depending on whether the abovementioned sum is 

larger or smaller than the threshold value, a different 
binary number is stored in a memory, the sequence of 
binary numbers in said memory forming the 
abovementioned sequence of movement and standstill 
10 between successive fields. 

5. Method according to Claim 3 or 4 , characterized 
in that the threshold value is calculated taking into 
account the liaminance value of the current processed 

1 5 image . 

6. Method according to Claim 5, characterized in 
that the total luminance sum is calculated and the 
nominal threshold value chosen is a specific fraction 

20 of said luminance sum, said nominal value optionally 
being adjusted, in particular being doubled or halved, 
in order to take account of the processing mode and, if 
edge boosting is being carried out, to take account of 
the status of said edge boosting. 

25 

7 . Method according to any one of the preceding 

claims, characterized in that, if film mode is 
detected, the processing of the data is synchronized 
with the film phase by using oscillating shift 

3 0 registers to continuously transmit a sequence 
corresponding to the 2:2 pull-down mode and/or a 
sequence corresponding to the 3:2 pull -down mode and, 
if one of the corresponding mode is detected, to 
synchronize with a synchronization pulse transmitted by 

3 5 the detection of the sequences of movement and 
standstill between the successive fields. 



8. Method according to Claim 7, characterized in 

that in the event of non- synchronization or detection 
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of an error in the film phase, a changeover to film the 
synchronization mode is carried out, the sensitivity of 
the detection of movement again being set to a high 
level and the processing temporarily again being 
5 carried out by median filtering until the film phase is 
observed again. 

9. Method according to any one of Claims 5 to 8, 
characterized in that in the event of film mode being 

10 detected and of synchronization the threshold value is 
increased so that the sensitivity of the detection of 
movement or standstill decreases. 

10 . Method according to any one of the preceding 
15 claims, characterized in that the incoming signals are 

subjected to edge boost by said signals being filtered 
by means of two phase- linear filters having a 
coefficient sum of 0, namely a band-pass filter 
preferably having the coefficients -10 2-1 and a 
20 high-pass filter having, for example, the coefficients 
-1 2 -1, after which the result of these filtering 
operations is merged and scaled. 

11. Method according to any one of the preceding 
25 claims, characterized in that the video signals to be 

processed are subjected to doubling or quadrupling 
and/or field rate doubling. 

12. Method according to Claim 11, characterized in 
3 0 that the interlaced video signals to be processed are 

converted into non-interlaced video signals by means of 
a 3 -point median filtering operation whose result is 
stored in a memoiry bank, and a field rate upconversion 
is performed by said memory bank constantly being read 
35 out at a higher rate than normal, preferably double the 
rate, for example at a frequency of 100 or 120 Hz 
instead of 50 or 60 Hz. 
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13. Method according to Claim 11, characterized in 
that the interlaced video signals to be processed are 
converted into non-interlaced video signals by means of 
a 3 -point median filtering operation whose result is 

5 stored in a first memory bank and these video signals 
are simultaneously subjected to an interpolation whose 
result is stored in a second memory bank, after which 
successively a line from the one and a line from the 
other memory bank is read, and a field rate 

10 upconversion is performed by the contents of 
successively the first and the second memory bank 
constantly being read out at a higher rate than normal, 
preferably double the rate, for example at a frequency 
of 100 or 120 Hz instead of 50 or 60 Hz, and, for 

15 correct interlacing, the outgoing frame pulse being 
shifted, every other frame, by half a line. 

14 . Apparatus for employing the method according to 
any one of the preceding claims, characterized in that 

20 it includes a movement detector (11) , a film mode /video 
mode detector connected thereto, a synchronizer (21) to 
synchronize processing with the film phase, and a film 
processor proper, 

25 15, Apparatus according to Claim 14, characterized 

in that the movement detector (11) is connected to a 
median filter (1) having as inputs the current field 
and the next field of the video images, and includes 
two low-pass filters (13 and 14) , one of which connects 

3 0 to the output of the median filter (1) and the other 
has as an input (12) the information of the next 
incoming field, a differentiator (15) which connects to 
the two low-pass filters (13 and 14) to calculate the 
difference between the outputs of these, a summator 

3 5 (16) connected to said differentiator (15) , a counter 

(17) connected to said summator (16) and a comparator 

(18) connected thereto for comparing the output of the 
counter (17) with a threshold value. 
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16. Apparatus according to Claim 15, characterized 
in that the film mode/video mode detector includes a 
shift register (19) in which the result of the 
comparator (18) over a number of fields is stored, so 

5 that a comparison is possible with a pattern inherent 
to a specific mode. 

17 . Apparatus according to any one of Claims 14 to 

16, characterized in that the synchronizer (21) 
10 includes at least one oscillating shift register or so- 
called "syncer" (22 or 23) which continuously transmits 
the sequence corresponding to the sequence of movement 
and standstill between successive fields for 2:2 pull- 
down or 3:2 pull-down, respectively, and preferably two 

15 shift registers or "syncers" (22 and 23), one for 2:2 
pull-down and one for 3:2 pull-down. 

18. Apparatus according to any one of Claims 14 to 

17, characterized in that the film processing proper 
20 includes means for merging matching fields of a film 

image and for repeating the merged images . 

19. Apparatus for video processing, characterized 
in that they include means for employing doubling 

25 and/or means for performing quadrupling, and a field 
rate converter from, for example, 50 or 60 Hz to 100 or 
120 Hz. 

20. Apparatus according to any one of Claims 14 to 
30 18 and according to Claim 19, characterized in that as 

well as a movement detector (11) , a film mode /video 
mode detector, a synchronizer (21) and a film processor 
it includes means for employing doubling and/or means 
for performing quadrupling, and a field rate converter. 

35 

21. Apparatus according to Claims 15 and 20, 
characterized in that the means for performing doubling 
and/or the means for performing quadrupling include a 
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median filter (1) which also forms part of the movement 
detector (11) . 
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